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Abstract 

Background: The effectiveness of currently licensed vaccines against influenza has not been clearly established, especially 
annong individuals at increased risk for complications from influenza. We used a test-negative approach to estimate 
influenza vaccine effectiveness (IVE) against hospitalization with laboratory-confirmed influenza based on data collected 
from the Global Influenza Hospital Surveillance Network (GIHSN). 

Methods and Findings: This was a multi-center, prospective, active surveillance, hospital-based epidemiological study 
during the 2012-2013 influenza season. Data were collected from hospitals participating in the GIHSN, including five in 
Spain, five in France, and four in the Russian Federation. Influenza was confirmed by reverse transcription-polymerase chain 
reaction. IVE against hospitalization for laboratory-confirmed influenza was estimated for adult patients targeted for 
vaccination and who were swabbed within 7 days of symptom onset. The overall adjusted IVE was 33% (95% confidence 
interval [CI], 11% to 49%). Point estimates of IVE were 23% (95% CI, -26% to 53%) for influenza A(H1 Nl)pdm09, 30% (95% 
CI, -37% to 64%) for influenza A(H3N2), and 43% (95% CI, 1 7% to 60%) for influenza B/Yamagata. IVE estimates were similar 
in subjects <65 and >65 years of age (35% [95% CI, -15% to 63%] vs.31% [95% CI, 4% to 51%]). Heterogeneity in site- 
specific IVE estimates was high (1^ = 63.4%) for A(HlNl)pdm09 in patients >65 years of age. IVE estimates for influenza B/ 
Yamagata were homogenous (1^ = 0.0%). 

Conclusions: These results, which were based on data collected from the GIHSN during the 2012-2013 influenza season, 
showed that influenza vaccines provided low to moderate protection against hospital admission with laboratory-confirmed 
influenza in adults targeted for influenza vaccination. In this population, IVE estimates against A(HlNl)pdm09 were 
sensitive to age group and study site. Influenza vaccination was moderately effective in preventing admissions with 
influenza B/Yamagata for all sites and age groups. 



Citation: Puig-Barbera J, Natividad-Sancho A, Launay O, Burtseva E, Ciblak IVIA, et al. (2014) 2012-2013 Seasonal Influenza Vaccine Effectiveness against Influenza 
Hospitalizations: Results from the Global Influenza Hospital Surveillance Network PLoS ONE 9(6): e100497. doi:10.1371/journal.pone.0100497 

Editor: Suryaprakash Sambhara, Centers for Disease Control and Prevention, United States of America 

Received February 24, 2014; Accepted IVlay 24, 2014; Published June 19, 2014 

Copyright: © 2014 Puig-Barbera et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits 
unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. 

Funding: The study was funded by a collaboration between CSISP (now FISABIO) in Valencia, Spain; INSERM and the French Vaccine Research Network (REIVAC) 
in France; the D.I. Ivanovsky Institute of Virology in Moscow, Russian Federation; the Research Institute of Influenza in St. Petersburg, Russian Federation; the 
National Influenza Reference Laboratory Capa-lstanbul, Turkey; and Sanofi Pasteur. Sanofi Pasteur participated in the design of the study but did not participate in 
the collection, management, analysis, or interpretation of the data, writing the manuscript, or the decision to submit the manuscript for publication. 

Competing interests: The authors have read the journal's policy and we have the following conflicts: JPB works for the Vaccines Research Area of FISABIO, 
which has received funding from GlaxoSmithKline, Novartis, Pfizer, Sanofi Pasteur, and Sanofi Pasteur-MSD for conducting studies on infectious disease 
epidemiology, vaccine effectiveness, pharmacoeconomics, and safety. The Vaccines Research Area is and has been involved in various randomized clinical trials 
with GlaxoSmithKline, Novartis, Pfizer, and MSD vaccines. AT is a member of a program funded by Sanofi Pasteur. OL has been an investigator on vaccine studies 
sponsored by and has received travel support to attend scientific meetings from Sanofi Pasteur and other pharmaceutical companies. Finally, the authors confirm 
that their competing interests, as previously stated, do not alter their adherence to PLOS ONE policies on sharing data and materials. All other authors declare no 
conflicts of interest. 

* Email: puigJoa@gva.es 

11 IVlembership of the GIHSN Group is provided in the Acknowledgements. 



Introduction 

Influenza vaccination is universally recommended for individ- 
uals at increased risk for complications, but the effectiveness of 
current licensed vaccines has not been clearly established [1,2]. 
Observational field studies have shown substantial variability in 
influenza vaccine effectiveness (IVE) by season, strain, and age 



group [3-6] . In addition, many of these studies are underpowered 
for subgroup analyses, complicating estimates of IVE for 
individual risks. Furthermore, differences in study design and 
outcome measures limit the ability to compare results across 
studies, and the external validity of the results is weakened when 
the study population does not fully represent the diflerent 
vaccination settings worldwide. 
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Several networks have been created to provide more represen- 
tative and robust estimates of rVE[7~ll]. These networks use a 
more standardized approach for data collection, analysis, and 
reporting of IVE, but most employ passive surveillance and 
therefore are highly dependent on reporting timeliness and 
completeness [12-14]. Also, few networks include surveillance of 
severe cases requiring hospitalization. 

The Global Influenza Hospital Surveillance Network (GIHSN) 
was launched in 2012 to address growing awareness that 
influenza-related hospitalization is a significant burden that 
remains insufficiently characterized. The GIHSN is a partnership 
between industry and pubUc health institutions that uses active 
surveillance and a common core protocol to collect data on the 
epidemiology of severe influenza, as defined by hospitalization 
with laboratory-confirmed influenza. The principal aim of the 
GIHSN is to estimate, when feasible, IVE against hospitalization 
with influenza. Data collection in the GIHSN is coordinated by 
regional centers. In the GIHSN's first season (2012-2013), five 
coordinating centers covering 14 hospitals participated, including 
the Centra Superior de Investigacion en Salud Publica (now FISABIO) 
(X'alencia, Spain); the Reseau National d'Investigation Clinique en 
Vaccinologie (France), the Research Institute of Influenza (St. 
Petersburg, Russian Federation), the D.I. Ivanovsky Institute of 
Virology, Moscow, Russian Federation, and, as a pilot parmer, the 
National Influenza Reference Laboratory (Cappa-Istanbul, Tur- 
key). 

Here, we used a test-negative approach [15,16] to estimate IVE 
against hospitalization with laboratory-confirmed influenza. Va- 
lidity of the pooled dataset was assessed by quantifying the 
heterogeneity in the effect estimates across the different study sites. 

Materials and Methods 

Study Design 

This was a multi-center, prospective, active surveillance, 
hospital-based epidemiological study carried out during the 
2012-2013 Northern Hemisphere influenza season. Data were 
collected from 14 hospitals, including five located in Valencia, 
Spain (Hospital General de CasteUon; Hospital de la Plana; 
Hospital Pesset; Hospital San Juan de Alicante; Hospital General 
de Elda), five in France (Cochin Hospital, Paris; Bichat Hospital, 
Paris; Limoges Hospital; St. Eloi Hospital, Montpellier; Lyon 
Hospital), and four in the Russian Federation (City Infectious 
Diseases Hospital #30, St. Petersburg; Children's Infectious 
Hospital #5, St. Petersburg; Children's City Hospital #4, St. 
Petersburg; Clinical Hospital for Infectious Diseases, Moscow). 
Hospitals in Turkey were not included because they were pilot 
partners at the time of this study. The principal objective was to 
estimate IVE against hospitalization with laboratory-confirmed 
influenza. 

The protocol used by the GIHSN was approved by each site's 
Ethics Research Committee: Comite Etico de la Direccion General de 
Salud Publicay Centro Superior de Investigacion en Salud Publica (CEIC- 
DGSP-CSISP); Comite de Protection des Personnes Ik-de-France III; 
Ethic Committee of Hospital #1 for Infectious Diseases of 
Moscow Health Department; Ethics Committee of the Research 
Institute of Influenza, St. Petersburg; Istanbul University, Istanbul 
Faculty of Medicine, Ethical Committee for Clinical Research. All 
patients provided written informed consent. Briefly, data on 
hospitaUzed patients with a diagnosis possibly associated with 
influenza were collected by an active surveillance system 
composed of healthcare professionals trained to follow a generic 
study protocol, and influenza was confirmed by reverse transcrip- 
tion-polymerase chain reaction (RT-PCR). At each site, case 



identification was adapted to the specific local settings of the health 
care delivery system and type of hospital, although all sites used 
the same case criteria for definitive inclusion and, in all cases, the 
study was conducted over a period defined by the weeks with 
positive specimens for influenza (Table SI). The study was 
conducted according to Ethical Principles for Medical Research 
Involving Human Participants of the World Medical Association, 
the Declaration of Helsinki, and the International Ethical 
Guidelines for Epidemiological Studies. 

Study Population 

Non-institutionalized adults that were residents of Valencia, 
Spain or who held a national social security affiliation (France) and 
were hospitalized for at least 24 h in one of the participating 
hospitals were considered for inclusion in the GIHSN database. 
Also, patients admitted at the emergency department (Valencia, 
France, Russian Federation) and at certain hospital wards (France, 
Russian Federation) were considered if they had pre-defined chief 
complaints presumably associated with a previous influenza 
infection [6] . After informed consent was obtained, patients were 
screened for the following inclusion criteria: onset of influenza-like- 
illness (ILI) within 7 days of admission to the hospital; influenza 
vaccination not contraindicated; not previously positive for 
influenza virus in the 2012-2013 season; and not hospitalized 
within 30 days of the current admission. ILI was defined as the 
presence of at least one systemic symptom (fever or feverishness, 
malaise, headache or myalgia) and at least one respiratory 
symptom (cough, sore throat or shortness of breath). 

Study Conduct 

At enrollment, a nasopharyngeal and a pharyngeal swab were 
collected and patients were interviewed by a hospital physician, 
clinical research associate, or both (Russian Federation and 
France) or a dedicated study nurse (Valencia). Swabs were stored 
at — 20°C. The following data were collected during the interview 
or by searching clinical records: demographic characteristics; 
anthropometric measures; information on the ILI episode; dates of 
symptom onset, hospitalization, and swabbing; antiviral treatment 
received; intense care unit admission; death during hospitalization; 
main hospital admission and discharge diagnostics; presence of 
chronic diseases; pregnancy status; number of hospital admissions 
in the past 1 2 months; number of general practitioner consulta- 
tions in the previous 3 months; smoking habits; and \ accination 
against influenza in the current (2012-2013) and previous (201 1- 
2012) seasons. Physicians involved in cfinical care of patients were 
also involved in patient recruitment but were not involved in case 
ascertainment. 

Social class was assigned according to occupation as described 
previously [17]. Functional status before ILI onset was ascertained 
in patients S65 years of age using the Barthel index [18] and 
categorized as follows: total dependence, 0-15; severe dependence, 
20-35; mild to moderate dependence, 40-90; no dependence, ^ 
95. Vaccination status during tlu- currc-nt season was ascertained 
from registries, vaccination cards, and interviews with patients, 
their families, and their physicians. Patients were considered 
vaccinated if they had received at least one dose of the 2012-2013 
seasonal vaccine >14 days before the onset of ILI symptoms. 
Local vaccination policies and vaccines available at each 
coordinating site are summarized in Table S2. 

Laboratory Confirmation of Influenza 

Commercially available (Russian Federation) or in-house 
(Valencia and France) RT-PCR assays were used to detect 
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-■-A(H1N1)pdm09 H(A3N2) 

A/untyped -»«-B/Yamagata 

— BA/ictoria B/untyped 

Figure 1. Number of admissions by epidemiological week at each site. The number of patients enrolled and included in the IVE analysis is 

shown by epidemiological week at each site for each influenza strain. 

doi:10.1371/journal.pone.0100497.g001 



influenza A (subtypes H3 and HI) and influenza B (Yamagata and 
Victoria lineages) viruses in swabs (Text SI). 

Data Management, Calculations, and Statistical Analysis 

Coordinating sites coUected anonymized data and checked for 
missing, inconsistent, or incorrect data. Whenever possible, queries 
of any inconsistencies or missing data were resolved by the 
investigators at each of the study sites. Missing data were not 
replaced for the statistical analyses. Data from each coordinating 
site were shared with the network coordinating center (FISABIO, 
Valencia, Spain) through a secured web-based system. 

Differences in the distribution of variables were estimated using 
a chi-square or T-test. A P-value of less than 0.05 was considered 
to indicate statistical significance. 

The primary outcome measure was hospital admission with 
laboratory-confirmed influenza. Secondary outcome measures 



were hospital admissions with laboratory-confirmed influenza 
A(HlNl)pdm09, A(H3N2), or B/Yamagata. 

IVE was determined in patients & 1 8 years of age who had been 
swabbed within 7 days of the onset of ILI symptoms and who had 
been targeted for influenza vaccination because they were obese, 
pregnant, or a65 years of age, or had recorded comorbidities 
[19]. In addition, patients were excluded from IVE estimates and 
analysis if they had received a homeopathic vaccine. IVE was 
estimated as (1 —odds ratio[OR]) x 100, where the OR compared 
the vaccine coverage rate between influenza-positive and influen- 
za-negative patients. Records for which outcome, exposure, or 
confounding variables were missing were excluded from the 
multivariate IVE analyses. The adjusted IVE was estimated by 
logistic regression using a random effects model with study site as a 
shared parameter for the pooled analysis and including week of 
symptom onset as a continuous variable, and age group, sex. 
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Table 3. Characteristics of patients included in the IVE analysis by RT-PCR result. 









Influenza-negative 


Influenza-positive 




Category 


Subcategory 


n (%) 


n (%) 


P Value 


Total 




1509 (69.1) 


675 (30.9) 


NC 


Age 


1 8-49 y 


407 (27.0) 


338 (50.1) 


<0.001 




50-64 y 


225 (14.9) 


95 (14.1) 






65-74 y 


239 (15.8) 


85 (12.6) 






75-84 y 


379 (25.1) 


101 (15) 






2:85 y 


259 (17.2) 


56 (8.3) 




Sex 


Female 


799 (53) 


457 (67.7) 


<0.001 




Male 


710 (47) 


218 (32.3) 




Comorbidities 


0 


376 (24.9) 


297 (44) 


<0.001 




1 


512 (33.9) 


219 (32.4) 








621 (41.2) 


1 59 (23.6) 




Obese (body mass 
index 


Yes 


427 (28.3) 


163 (24.2) 


0.115 


Hospitalized In 
the last 12 months^ 


Yes 


480 (32) 


126 (18.8) 


<0.001 


General practitioner 
visits last 3 months'* 


0 


567 (37.6) 


376 (55.7) 


<0.001 




1 


318 (21.1) 


117(17.3) 






£2 


575 (38.1) 


155(23) 




Smoking 


Never 


725 (48.1) 


385 (57) 


<0.001 




Past 


525 (34.8) 


168 (24.9) 






Current 


259 (17.2) 


122 (18.1) 




Socioeconomic 
class 


Professional to 
non-manual-skilled 


401 (26.6) 


256 (37.9) 


<0.001 




Manual-skilled 


178 (11.8) 


67 (9.9) 






Manual-non- 
skilled 


638 (42.3) 


143 (21.2) 






Unknown 


292 (19.4) 


209 (31) 




Functional 
capacity 


No Impairment'^'^ 


536 (61 .2) 


146 (60.3) 


<0.001 


Influenzavacclnatlon^ 


2012-2013 


641 (42.5) 


132 (19.6) 


<0.001 


Influenza vaccination 
based on medical 
records only 


2012-2013 


584(38.7) 


112(16.6) 


<0.001 




2011-2012' 


638 (42.3) 


152 (22.5) 


<0.001 


Time from onset of 
symptoms to swabbing 


1 to 2 d 


448 (29.7) 


260 (38.5) 


<0.001 




3 to 4 d 


641 (42.5) 


283 (41.9) 






5 to 7 d 


420 (27.8) 


132 (19.6) 





P-values were determined by Pearson's chl-square test. NC, not calculated. 
''N = 2158. 
"N = 2032. 
=N= 1069. 

^No Impairment defined as a Barthel score >60. 

"^Data on vaccination were exclusively from self-reporting for only 5.2% of all vaccinated patients. None of the patients with clinical records of vaccination self-reported 
not having been vaccinated. 
'N = 2168. 

doi:1 0.1 371 /journal.pone.Ol 00497.t003 



hospitalization in the previous 12 months, presence of chronic 
conditions, and smoking habits as potential confounding factors. 
Parameters not normally distributed were transformed prior to 
analysis. Polynomial fitting was used for non-linear relationships 
between week of symptom onset and influenza positivity. The 
nonlinear relationship between the week of symptom onset 



(independent variable) and influenza positivity (dependent vari- 
able) was modeled as an n''^ order polynomial, yielding the general 
polynomial regression model y=Po-l-Pix -I-P2X2 +P3x3+...PnXn + 
Syz; -I- where the expected value of a dependent variable y (log 
of the odds of either influenza positivity overall, HlNl, H2N3, B/ 
Yamagata or B/ Victoria) was modeled in terms of the value of the 
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Table 4 



. Characteristics of patients included in the IVE analysis according to vaccination the current year (2012-2013) 









Not 

vaccinated 


Vaccinated 




Category 


Subcategory 


n (%) 


N (%) 


/^value 


Total 




1411 (64.6) 


773 (35.4) 


NC 


Age group 


1 8-49 y 


713 (50.5) 


32 (4.1) 


<0.001 




50-64 y 


236 (16.7) 


84 (10.9) 






65-74 y 


171 (12.1) 


153 (19.8) 






75-84 y 


185 (13.1) 


295 (38.2) 






2:85 y 


106 (7.5) 


209 (27) 




Sex 


Female 


944 (66.9) 


312 (40.4) 


<0.001 




Male 


467 (33.1) 


461 (59.6) 




Comorbidities 


0 


605 (42.9) 


68 (8.8) 


<0.001 




1 


460 (32.6) 


271 (35.1) 






>2 


346 (24.5) 


434 (56.1) 




Obese (body mass 
index >30f 


Yes 


367 (26) 


223 (29) 


0.244 


Hospitalized in the 
last 12 months" 


Yes 


298 (21.3) 


308 (40) 


<0.001 


General practitioner 

visits in the last 3 months^ 


0 


809 (57.3) 


134 (17.3) 


<0.001 




1 


238 (16.9) 


197 (25.5) 






22 


313 (22.2) 


41 7 (54) 




Smoking 


Never 


754 (53.4) 


356 (46.1) 


<0.001 




Past smoker 


372 (26.4) 


321 (41.5) 






Current smoker 


285 (20.2) 


96 (12.4) 




Socioeconomic 
class 


Professional to 
non-manual-skilled 




OA (^^^Q\ 


<0.001 




Manual-skilled 


171 (12.1) 


74 (9.6) 






Manual-unskilled 


356 (25.2) 


425 (55) 






Unknown 


311 (22) 


190 (24.6) 




Functional capacity 


No impairment*^'^ 


260 (56.3) 


422 (64.2) 


<0.001 


Influenza vaccine 


Previous 

season (2011-2012)' 


130 (9.2) 


660 (85.4) 


<0.001 



P-values were determined by Pearson's chi-square test. NC, not calculated. 
''N = 2158. 
"N = 2032. 
'N= 1069. 

^No impairment defined as a Barthel score >60. 
'N = 2168. 

doi:1 0.1 371 /journal.pone.Ol 00497.t004 



independent variable x (week of onset), Pj, are tlie coefEcients, Zyz; 
are the effects of the covariates, and [J,; are the random effects 
representing between-site variability [20]. Sensitivity analysis was 
performed by including only samples taken within 4 days of 
symptom onset. A P-value <0.05 was considered to indicate 
statistical significance. Heterogeneity in IVE estimates was 
assessed using the statistic [21-23]. Potential sources of 
heterogeneity, including coordinating site, age, and influenza 
subgroup were examined in ad-hoc analyses. Heterogeneity was 
defined as low if statistic <25%, moderate if 25% to 49%, high 
if >50% as described previously [2 2]. 

Statistical analyses were performed using Stata version 13.1 
(College Station, TX). 



Results 

Patients 

A total of 9150 patients were screened by the 14 participating 
hospitals (Table 1). A total of 6581 patients met the criteria for 
inclusion in the GIHSN database. Of these, 2184 patients met 
criteria for and had available data for inclusion in the IVE analysis 
(896 in Valencia, 371 in France, 121 in St. Petersburg, and 670 in 
Moscow). 

The most important reasons for exclusion from IVE analysis 
were not meeting the ILI case definition(n = 1461), being 
hospitalized outside of the analysis period (n = 839), having more 
than 7 days between symptom onset and hospital admission 
(n = 553), aged under 18 years (n= 1923) and not belonging to 
population targeted for vaccination (n= 773). Most of the 
exclusions (4016 of 4667) were in Valencia and were due to the 
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Table 5. Characteristics of patients included in the IVE analysis at each site. 









Valencia 
(N = 1022) 


St. Petersburg 
(N = 121) 


Moscow 
(N = e70) 


France 
(N = 371) 


Overall (N = 2184) 


Category 


Subcategory 


n (%) 


n (%) 


n (%) 


n (%) 


n (%) 


Age group 


1 8-49 y 


66 (6.5) 


37 (30.6) 


578 (86.3) 


64 (17.3) 


745(34.1) 




50-64 y 


140 (13.7) 


56 (46.3) 


55 (8.2) 


69 (18.6) 


320 (14.7) 




65-74 y 


225 (22.0) 


14 (11.6) 


20(3.0) 


65 (17.5) 


324 (14.8) 




75-84 y 


359 (35.1) 


1 2 (9.9) 


14 (2.1) 


95 (25.6) 


480 (22.0) 




>85 y 


232 (22.7) 


2 (1.7) 


3 (0.5) 


78 (21.0) 


315 (14.4) 


Sex 


Male 


559 (54.7) 


52 (43.0) 


121 (18.1) 


196 (52.8) 


928 (42.5) 




Female 


463 (45.3) 


69 (57.0) 


549 (81.9) 


175 (47.2) 


1256 (57.5) 


Comorbidities 


0 


135 (13.2) 


27 (22.3) 


465 (69.4) 


46 (12.4) 


673 (30.8) 




1 


378 (37.0) 


67 (55.4) 


159 (23.7) 


127 (34.2) 


731 (33.5) 




>2 


509 (49.8) 


27 (22.3) 


46 (6.9) 


198 (53.4) 


780 (35.7) 


Hospitalized in 
the last 12 months" 


Yes 


370 (36.2) 


13 (11.9) 


54 (8.1) 


169 (45.6) 


606(27.8) 


General practitioner 
visits last three months'^ 


0 


264 (25.8) 


75 (62.0) 


603 (90.0) 


1 (0.3) 


943 (43.2) 




1 


266 (26.0) 


23 (19.0) 


37 (5.5) 


109 (29.4) 


435 (19.9) 




^2 


492 (48.1) 


12 (10.0) 


30 (4.3) 


196 (52.8) 


730 (33.42) 


Smoking 


Never 


462 (45.2) 


86 (71.1) 


391 (58.4) 


171 (46.1) 


1110 (50.8) 




Past 
smoker 


389 (38.1) 


4 (3.3) 


183 (27.3) 


117 (31 .5) 


693 (31 .7) 




Current 
smoker 


171 (16.7) 


31 (25.6) 


96 (14.3) 


83 (22.4) 


381 (17.5) 


Time from onset 
of symptoms to 
swabbing 


1 to 2 d 


230 (22.5) 


36 (29.8) 


337 (50.3) 


105 (28.3) 


708 (32.4) 




3 to 4 d 


483 (47.3) 


56 (46.3) 


233 (34.8) 


152 (41.0) 


924 (42.3) 




5 to 7 d 


309 (30.2) 


29 (24.0) 


100 (14.9) 


114 (30.7) 


552 (25.3) 


Disability' 


No 

Impairmen 
t 


52 (63.9) 


6 (21.4) 


0(0) 


155 (65.1) 


682 (61) 


Vaccinated for Yes 

influenza during 

the current season (2012-2013) 


566 (55.4) 


4 (3.3) 


5 (0.8) 


198 (53.4) 


773 (35.4) 



"Missing: St. Petersburg, n = 12; France, n^l. 
"^Missing: St. Petersburg, n = ll; France, n = 65. 

*^Presented only for patients >65 years of age. No impairment defined as a Barthel score >60. Data missing: St. Petersburg, n = 13; Moscow, n = 37. 
doi:l 0.1 371 /journal.pone.Ol 00497.t005 



broad selection criteria, which were designed to capture the 
maximum number of patients hospitalized for reasons that have 
been or could be associated with influenza infection. 

Influenza Positives 

Of the 2184 patients included, 675 (30.9%) tested positive for 
influenza by RT-PCR (Table 2). A(HlNl)pdm09 was the most 
frequently identified influenza virus (41.9%), followed by B/ 
Yamagata (28.9%) and influenza A(H3N2) (15.1%). 

Strains isolated at each site. B/Yamagata was the 
predominant strain isolated from patients in Valencia (63.5% of 
isolates), while A(HlNl)pdm09 predominated in Moscow (58.8% 
of isolates). In St. Petersburg, A(HlNl)pdm09 and B/Yamagata 
predominated and were present at similar frequencies. In France, 
A(H3N2) and B/Yamagata predominated (Table 2 and Figure 1). 

At each site, the distribution of strains in the patients changed as 
the season progressed (Figure 1). For example, in Valencia, B/ 
Yamagata predominated early in the season, with a peak at 



epidemiological week 2013-7, whereas A(HlNl)pdm09 predom- 
inated later in the season, with a peak at epidemiological week 
2013-13. In contrast, in St. Petersburg and Moscow, 
A(HlNl)pdm09 predominated early in the season, while B/ 
Yamagata predominated later. The pattern in France was different 
than either of these countries, with several strains coexisting 
throughout the influenza season. 

Strains isolated by age group. A(HlNl)pdm09 was more 
frequently isolated from patients <65 than &65 years of age 
(52.9% vs., 22.3%, p<0.001 by Chi^ test). B/Yamagata was more 
frequently isolated from patients S:65 than <65 years of age 
(55.8% vs. 13.9%, p<0.001 by Chi^ test). A(H3N2) was evenly 
distributed among both age groups. B/Victoria was isolated from 
only 18 patients (2.7% overaU) (Table 2). 

Patient Characteristics by Influenza Infection Status 

Influenza-positive patients were younger than influenza-nega- 
tive patients admitted to hospital (mean age, 5 1 vs. 63), less likely 
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Study 


Age 


Influenza 




site 


group 


virus strain 


n 


France 


>=65 


A(H1N1)pd 


10 


France 


>=65 


A(H3N2) 


29 


France 


>=65 


BA'amagata 


38 


H/loscow 


>=65 


A(H3N2) 


4 


Valencia 


>=65 


A(H1N1)pd 


35 


Valencia 


>=65 


A(H3N2) 


4 


Valencia 


>=65 


BA'amagata 


92 


France 


<65 


A(H1N1)pd 


18 


France 


<65 


A(H3N2) 


17 


France 


<65 


BA'amagata 


4 


Moscow 


<65 


A(H1N1)pd 


215 


Moscow 


<65 


A{H3N2) 


53 


Moscow 


<65 


BA'amagata 


12 


St. Petersburg 


<65 


A{H1N1)pd 


93 


St. Petersburg 


<65 


A(H3N2) 


45 


St. Petersburg 


<65 


BA'amagata 


80 


Valencia 


<65 


A{H1N1)pd 


28 


Valencia 


<65 


A(H3N2) 


1 


Valencia 


<65 


BA'amagata 


23 


Moscow 


>=65 


A(H1N1)pd 


6 


Moscow 


>=65 


BA'amagata 


2 


St. Petersburg 


>=65 


A{H1N1)pd 


5 


St. Petersburg 


>=65 


A(H3N2) 


6 


St. Petersburg 


>=65 


BA'amagata 


6 


Overall (l-squared = 7.f 


)%, p = 0.362) 





% 


% 


influenza 


Influenza 


positive 


negative 


vaccinated 


vaccinated 


30 


69 


45 


30 


58 


70 


25 


0 


63 


62 


75 


63 


47 


63 


11 


28 


24 


11 


50 


53 


0 


2 


0 


0 


0 


0 


3 


7 


4 


3 


5 


3 


25 


28 


- 100 


25 


13 


25 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



.1 1 

OR <br laboratory-confirmed influenza 



10 



Figure 2. Heterogeneity of IVE estimates at each site overall. 

doi:1 0.1 371/journal.pone.01 00497.g002 



to be men, less likely to suffer from comorbidities, and less likely to 
have been hospitalized in the last year but more likely to have 
never smoked and more likely to have professional or non-manual 
skilled jobs (Table 3). Influenza-positive patients were less likely 



than influenza-negative patients to have been vaccinated for 
seasonal influenza during the 2012-2013 and 201 1-2012 seasons. 
Of patients vaccinated for influenza during the 2012-2013 season. 



Influenza 
virus strain 



A(H1N1)pd 
AiH3N2) 
B/Yamagata 
A(H3N2) 
AH1N1 pd 
A(H3N2) 
BA'amagata 
A(H1N1Jpd 
B/Yamagata 
A(H1N1)pd 
AiH3N2) 
B/Yamagata 
32.7%, p = 0.179) 



A(H1N1)pd 
AiH3N2) 
B/Yamagata 
A(H1N1)pd 
AiH3N2) 
B/Yamagata 
A(H1N1)pd 
A(H3N2) 
B/Yamagata 
A(H1N1)pd 
A(H3N2) 
B/Yamagata 

Subtotal (l-squared = 0.0%, p = 0.490) 
Overall (l-squared = 7.6%, p = 0.362) 



Study 
site 


Age 

group 


>=65 




France 


>=65 


France 


>=65 


France 


>=65 


Moscow 


>=65 


Valencia 


>=65 


Valencia 


>=65 


Valencia 


>=65 


Moscow 


>=65 


Moscow 


>=65 


St. Petersburg 


>=65 


St. Petersburg 


>=65 


St. Petersburg 


>=65 


Subtotal (l-squared = 32 


<65 




France 


<65 


France 


<65 


France 


<65 


Moscow 


<65 


Moscow 


<65 


Moscow 


<65 


St. Petersburg 


<65 


St. Petersburg 


<65 


St. Petersburg 


<65 


Valencia 


<65 


Valencia 


<65 


Valencia 


<65 



10 

29 

38 

4 

35 

4 

92 

6 

2 

5 

6 

6 



18 
17 
4 

215 

53 

12 

93 

45 

80 

28 

1 

23 



10 



% % 

influenza Influenza 

positive negative 

vaccinated vaccinated 



30 


60 


45 


30 


58 


70 


25 


0 


63 


62 


75 


63 


47 


63 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


11 


28 


24 


11 


SO 


53 


0 


2 


0 


0 


0 


0 


3 


7 


4 


3 


5 


3 


25 


28 


100 


25 


13 


25 



.1 1 

OR for laboratory-confirmed influenza 



Figure 3. Heterogeneity of IVE estimates at each site for each age group. 

doi:1 0.1 371/journal.pone.01 00497.g003 
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Study 
site 


Age 
group 


Influenza 
virus strain 


n 


A(H1N1)pd 








France 


>=65 


A(H1Nl)pd 


10 


Valencia 


>=65 


A(H1N1)pd 


35 


France 


<65 


A(H1N1)pd 


18 


Moscow 


<65 


A(H1N1)pd 


215 


St, Petersburg 


<65 


A(H1N1)pd 


93 


Valencia 


<65 


A(H1N1)pd 


28 


It^oscow 


>=65 


A(H1N1)pd 


6 


St. Petersburg 


>=65 


A(H1N1)pd 


5 


Subtotal (l-squared 


= 31.6%,p 


= 0.198) 





>=65 


A(H3N2) 


29 


>=65 


A(H3N2) 


4 


>=65 


A(H3N2) 


4 


<65 


A(H3N2) 


17 


<65 


A(H3N2) 


53 


<65 


AH3N2) 


45 


<65 


A(H3N2j 


1 


>=65 


A(H3N2) 


6 


= 0.0%.p 


= 0.969) 





A(H3N2) 

France 

Moscow 

Valencia 

France 

Moscow 

St. Petersburg 

Valencia 

St. Petersburg 



B/Yamagata 
France 
Valencia 
France 
Moscow 
St. Petersburg 
Valencia 
Moscow 
St. Petersburg 

Subtotal (l-squared = 0.0%, p = 0.588) 
Overall (l-squared = 7.6%, p = 0.362) 



>=65 


8rfamagata 


38 


>=65 
<65 


B/Yamagata 


92 
4 


<65 


BA^amagata 
BA'amagata 


12 


<65 


B/Yamagata 


80 


<65 


B/Yamagata 


23 


>=65 


B/Yamagata 


2 


>=65 


B/Yamagata 


6 



"T" 



% 

influenza 

positive 

vaccinated 



11 
0 
3 
25 
0 
0 



45 
25 
75 
24 
0 
4 

100 
0 



47 
50 

0 
5 
13 
0 



% 

Influenza 
negative 
vaccinated 



69 
62 
26 
2 
7 
26 
0 
0 



30 
0 
63 
11 
0 
3 
25 
0 



70 

63 

53 

0 

3 

25 

0 

0 



.1 1 
OR for laboratory-confirmed influenza 



Figure 4. Heterogeneity of IVE estimates at each site for each strain. 

doi:1 0.1 371/journal.pone.01 00497.g004 



more influenza-negative patients had also received the 201 1-2012 
seasonal influenza vaccine. 

The mean interval between symptom onset and specimen 
collection was similar for influenza-positive and influenza-negative 
patients (mean ± standard deviation = 3.1 ± 1.6vs. 3.5±1.7 days), 
although more influenza-positive than influenza-negative patients 
were swabbed within 2 days. The risk of being influenza positive 
decreased by 3% (95% CI, 2% to 4%) (P for trend <0.0001) for 
each day elapsed between symptom onset and swabbing. 

Patient Characteristics by Vaccination Status 

Patients vaccinated during the year of the study (2012-2013) 
were older than unvaccinated patients (mean, 76 vs. 50 y) (Table 4). 
Vaccinated patients were also more likely to be men, suffer from 
chronic conditions, to have been hospitalized in the last year, to 
have visited the general practitioner in the last 3 months, to be past 
smokers, and to have been influenza-vaccinated the previous year 
(2011-2012). 

Patient Characteristics by Study Site 

Patients in St. Petersburg (76.9%) and Moscow (94.5%) were 
mostly <65 years of age and had either no or one chronic disease 
(Table 5), regardless of influenza infection status (Table S3). In 
Moscow, 72.1% (483/670) of the patients were pregnant women 
(mean age, 28 ±5 years). The patients in France and Spain were 
evenly spread across age groups, and at least 70% suffered from 
one or more chronic condition. The pattern of chronic conditions 
was similar in Valencia and France (cardiovascular disease, 
chronic obstructive pulmonary disease, and diabetes), whereas in 
Moscow and St. Petersburg, the main chronic illness reported was 
cardiovascular disease. The median (interquartile range) number 
of chronic illnesses in patients with comorbidities was 1 (1-2) in 
Valencia, 2 (1-2) in France, 1 (1-1) in St. Petersburg, and 0 (0-1) 
Moscow. Influenza vaccine uptake was low in Moscow (3.3%) and 



St. Petersburg (0.8%) but moderate in Valencia (55.4%) and 
France (53.4%). 

IVE 

Overall. Influenza-positive patients were less likely to have 
been vaccinated during the year of the study (2012-2013) than 
influenza-negative patients (adjusted OR = 0.67 [95% CI, 0.51 to 
0.89]; P= 0.0060). This corresponded to an overall adjusted IVE 
of 33% (95% CI, 11% to 49%) (Table 6). IVE was similar m 
patients <65 and >65 years of age (35% [95% CI, -15% to 
63%] vs. 31% [95% CI, 4% to 51%]). When pregnant women 
were excluded, values were similar (IVE [95% CI] = 33% [10% to 
49%] overaU, 15% [-23% to 54%] for A(HINI), 33% [-32% to 
66%]for A(H3N2), and 42% [16% to 60%]for B/Yamagata; data 
not shown). IVE estimates in subjects ^65 years of age were 
similar when adjusted for disability (i.e. Barthel score as a 
categorical variable) (data not shown). 

By strain. IVE estimates were 23% (95% CI, -26% to 53%) 
for influenza A(HlNl)pdm09, 30% (95% CI, -37% to 64%) for 
influenza A(H3N2), and 43% (95% CI, 17% to 60%) for influenza 
B/Yamagata(Table 6). IVE was higher in patients <65 years of 
age than in those &65 years of age for A(HlNl)pdm09 (40% 
[95% CI, -43% to 75%] vs. 13% [-68% to 55%]) and B/ 
Yamagata (52% [95% CI, -25% to 81%] vs. 41% [95% CI, 12% 
to 61 %]). Results were similar when the analyses were restricted to 
patients swabbed within 4 days of symptom onset (Table S4). 
Significant adjusted IVE estimates were obtained for all influenza 
in subjects &65 years of age and the B/Yamagata lineage, also in 
subjects S65 years of age. Analysis of the influence of 
socioeconomic factors was not possible due to a high proportion 
of "don't know" responses (data not shown). 
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Study 
site 



Age Influenza 
group virus strain 



A{H1N1)pd 

France <65 A(H1N1)pd 18 
Moscow <65 A(H1N1)pd 215 
St. Petersburg <65 A(H1N1)pd 93 
Valencia <65 A(H1N1)pd 28 
Subtotal (l-squared = 0.0%, p = 0.490) 

A(H3N2) 

France <65 A(H3N2) 17 
Moscow <65 A(H3N2) 53 
St. Petersburg <65 A(H3N2) 45 
Valencia <65 A(H3N2) 1 
Subtotal (l-squared = 0.0%, p = 0.802) 



BA'amagata 
France <65 
Moscow <65 
St. Petersburg <65 
Valencia <65 



B/Yamagata 4 

B/Yamagata 12 

B/Yamagata 80 

B/Yamagata 23 



Subtotal (l-squared = 0.0%, p = 0.459) 



Overall (l-squared = 0.0%, p = 0.490) 



o 



% % 

influenza Influenza 

positive negative 

vaccinated vaccinated 



11 


28 


0 


2 


3 


7 


ZD 


28 


24 


11 


0 


0 


4 


3 


100 


25 


SO 


S3 


0 


0 


5 


3 


13 


25 



o 



T 



1- 
10 
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Figure 5. Heterogeneity of IVE estimates for each strain in patients 18-64 years of age. 
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Heterogeneity in IVE Estimates 

Heterogeneity between sites was low for overall IVE estimates 
(I = 7.6%; P= 0.362) (Figure 2). Heterogeneity between sites was 
also low for IVE estimates in patients <65 years of age (I^ = 7.6%; 
P- 0.362) but moderate in patients &65 years of age (I = 32.7%; 
P=0.179) (Figure 3). Heterogeneity across sites in IVE estimates 
was moderate for A(HlNl)pdm09 (I^ = 31.6%; P= 0.198), where- 
as IVE estimates for each site were homogenous for A(H3N2) 
(1^ = 0.0%, P= 0.969) and B/Yamagata (1^ = 0.0%; P= 0.588, 
respectively) (Figure 4). 

rVE estimates against H3N2 or B/Yamagata were also 
homogenous when assessed by age group, strain, and study site 
(1^ = 0.0%; P>0.8) (Figures 5 and 6). Heterogeneity in FVE 
estimates was high (1^ = 78%; P= 0.0340) for A(HlNl)pdm09 in 
patients &65 years of age, with poorer protection in Valencia than 
in France. 

AU heterogeneity results were similar when assessed using 
adjusted IVE estimates (Figures SI, S2, and S3). 

Discussion 

This study, performed in three different countries during the 
2012-2013 influenza season, used a test-negative design to 
estimate IVE against hospitalization with laboratory-confirmed 
influenza in adults targeted for vaccination. All patients included 
in the IVE estimates and analysis had to have been tested for 
influenza within 7 days of the onset of ILI symptoms. The pooled 



adjusted IVE was 33% (95% CI, 11% to 49%) against 
hospitalization. Estimates of IVE for preventing hospital admis- 
sions were consistent and moderate across sites and age groups for 
influenza B/Yamagata (43% [95% CI, 17% to 60%]) but low and 
non-significant for influenza A(HlNl)pdm09 (30% [95% CI, - 
37% to 64%]) and A(H3N2) (23% [95% CI, -26% to 53%]). IVE 
estimates for A(HlNl)pdm09 were highly heterogeneous across 
study sites in patients ^65 years of age but not in younger patients. 
Influenza A(HlNl)pdm09 and B/Yamagata followed by A(H3N2) 
were the most common strains isolated. These results agree with 
other interim and preliminary results published for the 2012-2013 
influenza season [3,5,24—29]. 

The low IVE estimates in this study might have been due to 
genetic drift in influenza at key antigenic sites [5]. Genetic and 
possible antigenic mismatches have been described in Europe for 
A(HlNl)pdm09 and A(H3N2)[23-25]. Vaccines for the 2012- 
2013 season containing A/Victoria/36 1/201 1 antigens have been 
reported to induce antibodies in humans that bind less effectively 
to most cell-propagated influenza A(H3N2), apparently due to 
antigenic changes in earlier A/Victoria/361/201 l-like vaccine 
viruses associated with adaptation of the virus to propagation in 
eggs [30]. Accordingly, vaccines for the 2013-2014 northern 
hemisphere season are recommended to contain A(H3N2) virus 
that is antigenicaUy like the cell-propagated prototype virus A/ 
Victoria/361/201 1 [30]. In contrast, in two preliminary analyses 
of North American data, IVE was moderate and significant 
against A(H3N2), although this was associated with a good 
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Study 
site 



Age Influenza 
group virus strain 



A{H1N1)pcl 

France >=65 A(H1N1)pd 10 
Valencia >=65 A(H1N1)pd 35 
Moscow >=65 A(H1N1)pd 6 
St, Petersburg >=65 A(H1N1)pd 5 
Subtotal (l-squared = 77.8%, p = 0.034) 



% % 

influenza Influenza 

positive negative 

vaccinated vaccinated 



30 
63 
0 
0 



82 

0 

0 



A(H3N2) 

France >=65 A(H3N2) 29 
Moscow >=65 A(H3N2) 4 
Valencia >=65 A(H3N2) 4 
St, Petersburg >=65 A(H3N2) 6 
Subtotal (l-squared = 0.0%, p = 0.842) 



45 
25 
75 
0 



30 
0 
63 
0 



BA'amagata 

France >=65 BA'amagata 38 
Valencia >=65 BA'amagata 92 
Moscow >=65 BA'amagata 2 
St. Petersburg >=65 BATamagata 6 
Subtotal (i-squared = 0.0%, p = 0.837) 

Overall (l-squared = 32.7%, p = 0.179) 
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<> 



47 

0 
0 



70 
63 
0 
0 



T" 



10 



.1 1 
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Figure 6. Heterogeneity of IVE estimates for each strain in patients >65 years of age. 
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antigenic match between circulating and vaccine A(H3N2) strains 
[7,31], 

The IVE estimates in this study were similar to those reported in 
sentinel hospital-based studies [32,33] but were lower than 
reported for general practitioner-attended influenza out- 
comes [26,29], This might be because of different effectiveness 
for different clinical outcomes or because of the generally older age 
and poorer health of patients requiring hospital admission for 
influenza infections. Indeed, our study patients were, on average, 
older and in poorer health than those in the general practitioner 
sentinel studies. Also, in contrast to some of these general 
practitioner sentinel studies, our estimates of IVE against influenza 
A strains were similar across age groups. However, in all reports, 
including ours, IVE against B/Yamagata influenza was moderate, 
despite differences in baseline patient characteristics. 

The validity of IVE estimates can be influenced by nonspecific 
case definition, ascertainment, information bias and confounding. 
To overcome some of these limitations, we used a hospital-based 
active-surveiUance approach to identify eligible patients. Despite 
each site adapting screening criteria to the particular circum- 
stances of their health care systems and the participating hospitals, 
all sites consistently applied the network eligibility criteria. In 
addition, to reduce bias, at all sites, subjects were screened and 
included in the study without previous knowledge of their 
exposure or outcome status and belonged to the same population 
at risk for influenza infection, namely, those targeted for 
vaccination [3 4]. All sites used the common GIHSN core protocol 



and close follow-up and feedback between the coordination center 
and the different sites to ensure that standard procedures and 
monitoring were employed throughout the influenza season. 

We used a highly specific outcome definition of severe influenza, 
with influenza infection confirmed by RT-PCR performed in 
highly qualified central laboratories. To minimize the impact of 
false negatives on IVE estimates, we excluded patients swabbed 
more than 7 days after the onset of symptoms [34]. IVE was 
estimated using the widely used test-negative approach, which has 
been shown to give consistent results [15], and the analysis of IVE 
was restricted to periods with similar influenza circulation 
patterns[16,35]. Furthermore, the IVE was calculated on the 
basis of ORs determined using a random effects model, which 
allowed us to take into account potential differences, including 
type of vaccine, vaccination programs, the levels of immunity 
across different population and settings, and different use of 
hospital emergency departments [36,37]. 

Underlying heterogeneity across study sites may have compro- 
mised the accuracy of the overall IVE estimates. We observed high 
heterogeneity in the estimates of IVE against A(HlNl)pdm09 by 
site in patients &65 years of age. This was mainly due to opposing 
directions of IVE estimates in France and Valencia. Identifying the 
host and pathogen factors that may have contributed to this 
variability is complicated by limited understanding of the factors 
that affect annual IVE estimates [38]. One possibility for the 
heterogeneity is site-specific genetic and antigenic differences 
between circulating A(HlNl)pckn09 and seasonal vaccine virus- 
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es[25, 39,40] . We cannot exclude the possibility that the difTerences 
between sites are due, at least to some extent, to difTerent vaccines 
being used. 

The heterogeneity of pooled analyses from existing influenza 
networks and the relevance of IVE estimates across sites sharing a 
core standardized protocol remain largely unknown [41,42]. A 
thorough assessment and exploration of the heterogeneity inherent 
to multicenter studies is needed to evaluate the robustness of 
pooled IVE results and the identification of risk factors. One 
possible framework for understanding the heterogeneity of 
observational IVE data and how to interpret it is that provided 
by Beyer et al. who re-analyzed data from a 2010 Cochrane meta- 
analysis of IVE in the elderly [43]. By rearranging the data 
according to "a biological and conceptual framework based on the 
basic sequence of events throughout the 'patient journey'", they 
found a mean IVE against complications of 28'/'<) (95% CI, 26"/o to 
30%) and against laboratory-confirmed disease of 49% (95% CI, 
33% to 62%). They concluded that their findings provide 
"substantial evidence for the abiUty of influenza vaccine to reduce 
the risk of influenza infection and influenza-related disease and 
death in the elderly." Although both their and our analyses were 
based on heterogeneous source data, we had similar findings and 
reached similar conclusions on the effectiveness of influenza 
vaccines. 

The wide confidence intervals observed in our study suggests 
that small sample sizes may have compromised the precision 
around risk-specific IVE estimates and the power of statistical tests 
to detect all sources of heterogeneit)'. Therefore, random error 
could have affected our estimates. Accordingly, the IVE estimates 
should be interpreted with caution. The results of this study 
support the feasibility of estimating IVE against hospitahzation for 
laboratory-confirmed influenza based on a global active-surveil- 
lance hospital-based network. New sites in China and Brazil, and a 
fully operational site in Turkey will be joining the GIHSN in the 
2013-2014 season. This will increase its geographical representa- 
tiveness and sample size, which will improve the validity and 
accuracy of data on influenza vaccine effects and their variability. 
This is especiaUy important for attaining the principal pubhc 
health objectives of preventing morbidity and premature mortaUty 
in people at high risk for complications from influenza. 
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